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(54) Method and device for achieving high contrast surface illumination 



(57) A method and device for acquiring data related 
to topography of a medium ( 1 4 and 44) includes project- 
ing light, allowably from more than one direction, onto 
the surface of the medium at an angle (112 and 1 1 4) of 
less than sixteen degrees relative to the surface and im- 
aging the surface For example, the imaging sensor (24 
and 26; 73) may be an array of sensor elements that is 
used to determine navigation of a hand-held scanner 
along an original. By introducing light at an angle of less 
than sixteen degrees, surface irregularities cast shad- 
ows that form a high contrast illumination pattern along 



the surface of the medium The navigation sensor de- 
tects multi-element variations (64) of intensity of scat- 
tered light from the surface with respect to positions 
along the surface, so that the Nyquist criteria are ade- 
quately satisfied Typically, the light is collimaled inco- 
herent light, but this is not critical. The illumination angle 
can be established by using a prism (31 : 38) The prism 
may have an antireflective thin film coaling on one or 
more pnsm faces. The employment of a prism provides 
a number of advantages, such as use of a transparent 
surface in contact with the media and raising the illumi- 
nation source(s) away from the media. 
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Description 



The prescnl invenhon relaies soneraliy :o devices 
Hnd methods lor acquiring dala rclaSed :o Icpography cf 
medium and more speolically lo ,ilur-.,nalicn sources 
-nd opiics lor nign-speed acqu,s.;,on o: posilion oncoc- 
in:j and/or imaqc-roproducinc dala 

An accur<,ic dolcrminaiion oi roi.,!ivc rr.ovcmer.l 
Dciwcen a device and a specific surface is impcrtant in 
- vaneiy ol appficalions For example the conlinuous 
movcmcnl of a sheet o( paper through a photocopier 
may be mon.lorcd in order to allow precise idcntificalion 
ol the position ol the sheet along a paper path U S Pal 
No 5 149 950 to Enel el al . which ,s assigned to the 
Hssicnce o( the present invention describes a method 
and apparatus lor using a cross-correlaiion lunclicn lo 
determine the distance thai a sheet ot paper has moved 
'n H given direction through a photocopier printer or 
scanner 

In the preferred embodiment ol the Eilel et al meth- 
od « lineai anay of lighl sensois ,s used to receive and 
sense light rellected from the sheet ol paper Tne patent 
notes that (or practical applications, it .s necessary to 
compromise between directing a light source so as to 
9.-.in the benefits associated wilh normal light incidence 
and directing the light source to gam the benefits asso- 
ciated with grazing incidence At close lo normal inci- 
dence light reflection is highest but the light tends to 
wash oiil- the surlace texture of the papor so that the 
surface texture cannot be used to determine the dis- 
tance of Sheet movement. At the other extreme light di- 
rected at a grazing incidence will produce exaggerated 
shadowing o( Ihe surface texture, but ihe reflection per- 
pendicular lo the plane of the paper will be minimal i 
e Ihe light that reaches the light sensors will be mini- 3 
mal Consequently the compromise is described as 
necessary lor practical applications and the selection 
of the angle includes consideration ol the proximity of 
the lens barrel lo the paper and any other light path ob- 
structions 

In the use ol the patented method for determininq 
Ihe distance a sheet of paper has moved .n a given d. 
rcclion. paper fibers are viewed If the sensor array is a 
one-dimensional array Ihe patent describes the imag- 
ing device as a CCD array of 256 photo sue each hav- .5 
ing a square configuration A single photo site is 1 3 urn 
X 13 Mm. with the total length of the array being 3 328 
mm. A one-fouilh power optical de-magn,f,cal,on is 
used so that the CCD senses a section of paper that is 
1 3^31 2 mm long The field of view of an individual site so 
•s 52 Mm X 52 pm A typical cross section of a paper fiber 
.s approximately 25 pm Significant image blurring is 
then used to prevent the higher spatial frequences from 
causing signal aliasing 

While prior art techniques operate well lor the ap- ss 
plications for which they are designed, higher speed and 
or portable applications require significant advances in 
energy efficiency signal-to-noise ratios (SNR) position 
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ser,s,ng precision and accuracy and compactness One 
example is a hand■^eld pcrt^oio documenl scnrner 
can acquire and store a l.-:.^lul reprosontaticn ot an im- 
age of u scan.ncd ongma; lypically l.le c.piurcd imaq,^ 
provided by the sc.n.mnc device ,s a pi.el data arra^ 
hat IS stored ,n memory m a digital formal A distortion- 
ree .rTi,.qo require;, a fa,;,-;ui mappmq ot the imaqo to 
me pixel data array Scanners olten include al least one 
means lor imposmc a mechanical constraint during the 
■mage c^.piure process so as to maximize the likelmood 
Ol faithful mapping However if a scanning device ,s to 
be used w.thout such mechanical constraint laithlul ro- 
procuction becomes more dilficult and requires sensing 
two dimonsional positions and rotations The issu-es ol 
efficiency SN.R and accuracy are of equal concern in 
printing applications 

The prelerred embodiment seeks lo provide a com- 
pact and energy ellicient method and device for acquir- 
ing accurate navigation and/or pnni-image information 
in a low-cost manner that allows relal.vely quiCK move- 
mem ac.oss a medium ol inteiest. It may also p.ovide 
a device and method that acquires navigation informa- 
tion sufficient to accommodate curx'ilinear movement of 
the device during an operation that requires the device 
lo be scanned 

According to an aspect ol the presoni invention 

there IS providedamethoc of acquiringdata as specified 
in claim i 

According to another aspect cf Ihe present inven- 
tion, there is provided a device for acquiring dala as 
specified in claim 8 

The preferred embodiment provides an imaging 
method and device in which at least one illumination 
source directs radiation al a grazing angle of less than 
sixteen degrees relative to a surface of interest to pro- 
vide surface areas of high brightness and surface areas 
o low brightness. By directing the radiation at an angle 
of less than sixteen degrees from a surface raised sur- 
face irregularities cast shadows that provide a high^on- 
trast Illumination pattern within a region of interest on 
the surface In this embodiment, grazing illumination 
strikes Ihe region of interest from more than one direc- 
tion relative to the normal of the surface Where high 
scanning speeds are required, simultaneous grazing 
angle illumination from multiple directions raises signal 
level and enhances detectability ol the illumination pat- 
tern. If relative movement is Iniiiaied between first the 
surface ol interesl and second an array of sensor ele- 
ments that are fixed relative to the illumination source 
the high intensity features and low intensity features can 
be tracked in order to provide either or both of position 
encoding information and image information (or forming 
an image of the surlacc of interest. Thus, the image fea- 
tures of the surface define a unique pattern of surface 
topography, and the pattern is associated w.th the spe- 
cific region of the surface being sensed Moreover the 
pattern is more dependent upon larger surface features 
than individual fibers 
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The preferred Gmbodiment of delecting illumination 
fe^Jlures. where disp!?^cemenl or motion is involved, 
must satisfy a cross-sectfonal 2:1 ratio of fie!d-of-view 
size to feature size Nyquist criteria dictate that the di- 
mensions of shadows cast by surface trregulaniies be 
at least twice as larqe as the fieldof-view of an individual 
sensor element For use of the method and device in 
reproducing an image of the surface of a sheet o( paper, 
the high intensity and low intensity features may be a 
result of surface roughness formed by a screen in the 
paper manufacturing process While the surface rough- 
ness IS not typically visible to the human eye, projecting 
the light at less than sixteen degrees relative to the pa- 
per causes such surface roughness to cast shadows 
that provide an illumination pattern having sufficient 
depth ol intensity modulation lor tracking features that 
satisly the said cross section requirement. The features 
rendered with grazing light are generally larger than pa- 
per fibers and thereby enable higher scanning speeds, 
as will be explained below 

There are major advantages to illuminating surface 
features at angles of less than sixteen degrees Direc- 
tionality of lighting or collimalion is then required only in 
the incidence plane parallel to the surface normal, so 
that there is a greatly relaxed requirement for collimation 
in planes orthogonal to such an incidence plane. As a 
consequence, multiple illumination sources can be uti- 
lized, or a source extending parallel to the sudace and 
thereby able to define a large illumination area, can be 
utilized while still meeting the required degree of colli- 
mation within the planes of incidence for achieving high 
contrasts. Another significant advantage of sub-sixteen 
degree illumination is that by creating larger contrast 
features, sensor arrays with a fixed number of elements 
can have larger fields of view without violating the 
Nyquist criterion, thereby permitting capture of more sig- 
nal. This also increases signal strength by permitting 
longer sample integration. 

In the embodiment in v/hich an image of the surface 
of interest is to be formed, the surface irregularities may 
be print on the surface of a medium, such as a sheet of 
paper The sensor array and the illumination source may 
be secured to a hand-manipulable housing, such as a 
hand-held scanner As the housing is moved relative to 
the surface of the medium, signals from the sensor array 
track displacement of surface irregularities relative to 
the array For example, successive images of the illumi- 
nation pattern on the medium surface may be correlated 
to provide navigation information regarding the path that 
the housing is moved along the medium. 

The radiation from the illumination source will be re- 
ferred to herein as 'light.' but the radiation may be elec- 
tromagnetic radiation outside of the visible spectrum. 
While the source of illumination may bo a source of co- 
herent light, preferably incoherent light is used. 

There area variety of structural variations for imple- 
mentation of the grazing illumination and a variety of ap- 
plications, as will be set forth in greater detail below 



With regard to illumination sources, the grazing illumi- 
nation may be ( 1 ) from a single source (2) from one or 
more sources, each in a different plane of incidence or- 
thogonal to the surface but all directed onto a single sur- 
s face region in order to increase apparent surface bright- 
ness without a corresponding significant loss of con- 
trast; or (3) from more than one source onto separate 
portions of the surface region in order to provide cross- 
structured grazing illumination that improves symmetry 
wrthin applications in v/hich correlation is a faclor With 
regard to two of the possibilities for arrangement of op- 
tical elements, light energy may be directed at the sur- 
face at the desired angle and then collected, both by 
means of either; (1) a prism having a media-contacting 
window or (2) a one-piece molded optic that deflects 
normally incident illumination into sub-sixtoen degree il- 
lumination via a total-internal reflection mirror and thai 
includes a recessed media window. Possible applica- 
tions include medical imaging, original image reproduc- 

20 lion and acquisilion of surface navigation informalion 
In one implementation, collimated light is directed 
at the medium by means of a prism. There are a number 
of advantages to using a prism to define the paths from 
the illumination source to the medium and from the me- 

25 dium to the sensor array One advantage is that the an- 
gle of illumination toward the surface is larger within the 
prism than the eventual sub-sixteen degree or grazing 
angle upon exit from the prism for illumination of the sur- 
face of the medium This renders it easier to precisely 

30 translate a small cross sectional beam to stnke a desired 
target region of a surface. A second advantage is that 
the higher index of the prism means that less light will 
be lost through divergence in traveling the distance 
through the prism. Two disadvantages of using a prism 

35 are that light into the prism must be much better colli- 
mated and that the angle of incidence into the prism 
must be much more tightly controlled. 

Directing and collecting light by means of a prism 
provides a practical embodiment for grazing angle illu- 

•to mination. A prism allows use of multiple illumination 
sources, as may be required to distinguish a number of 
colors or to increase the contrast. 

In one embodiment, the light projection at an angle 
of less than sixteen degrees is accompanied or replaced 

■iS by optics for allov/ing normally Incident light projection, 
so that a user may select between the two forms of pro- 
jection, depending upon the likelihood that the frequen- 
cy of raised surface irregularities will allow accurate 
tracking of navigation. 

50 A thin film dielectric antireflection coating may be 

used on the distal surface of the prism in order to better 
couple incident illumination near the critical angle of to- 
tal internal reflection, thereby reducing beam power loss 
by reflection within the prism and increasing Iransmis- 

55 sion to the surface of the scanned medium. 

A diffuser may be used to help meet the Nyquist 
criteria of the sensor array The diffuser permits the high- 
er spatial frequencies within the surface-texture images 
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to bo blurred cr Tolled off ...,nout sacnCc.ng any dop.h 
Of field or signal power A bcsl embodirneni of Ih.s d,l- 
fusor IS a computer generated diflracnon element 
placed ,usi before .he imaging array such ihat mcdeni 
light directed toward a single sensor element ,s di.'fraci- s 
ed partially lo ncares! neighbor elements 

Rather than a prism, a ono-pieco molded optic may 
be used to deflect normally incident illumination ,nlo the 
desired low-angle illuminaiion via a loial .ntemal rellec- 
t.on (TIR) mirror Moreover, the optic preferably includes :o 
a recessed, out-of-focus, dust-proiechng medium win- 
dow Such a window provides a contact opi.c that does 
not ,n fact contact the medium at the target area itself 
This reduces the suscepiibil.iy of the device and method 
to adverse effects of imaging dust, dirt, and scratches 
and enables sub-sixteen degree illumination to be intro- 
duced below the window in order to avoid any compi - 
cations assocBtod with passing the low-angle illumina- 
tion through a glass-io-a.r .niertace thai is parallel to the 
surface of interest 

As previously noted, collimalior, and use of a prism 
are not cniical to the invention In fact, a Icw-spaiial fre- 
quency texture of a single surface region may be illumi- 
nated at sub-sixteen degree angles (rem more than one 
direction without a prism lo achieve increases in appar- 25 
ent surface brightness without comparable losses ,n 
coritrast. It areas of an illuminated surface region are 
sufficiently low relative lo surrounding areas, such that 
these low-lying areas will not be illuminaied by grazinq 
angle light regardless of its direction, preferably the ad 30 
ditional Illumination is introduced from more than one 
direction in order to increase the su.lace brightness at 
the high-lying areas without a significant loss of shad- 
ows at the low-lying areas 

In another embodiment, the region of interest is di- 
vided with respect to directions ol illumination As an ex- 
ample, a first grazing angle illumination is oriented gen- 
erally along the direction of rows of sensor elements in 
a sensor array, while a second grazing angle illumina- 
tion is oriented generally along the direction of columns 40 
in the array. If each illuminated region ,s 32x32 pixels 
the sensor array may be 32x64 elements, although 
there may be some intentional or unintentional overlap- 
ping of the two .lluminations By dividing the region of 
•merest in this manner, any preferential orientation of im- 
age contrasts in the media image is at least partially off- 
set, whether caused by media anisotropics or by the il- 
lumination directionality 

An advantage of the preferred method and device 
IS that the projection of light onto the surface of interest 50 
at an angle of less than sixteen degrees relative to the 
Gudace provides a surface illumination pattern that is 
rich ,n contrast. By tracking only those features of the 
Illumination pattern that satisfy Nyquist criterion on the 
cross sectional relationship with the field o( view of the ss 
sensor elements and/or by using a pnsm or similar op- 
ncs to first direct and then collect the light, a practical 
embodiment of gra7ing angle illumination and detection 



IS achieved Tna; ,s the need to osl<.bi.sh a compromise 
between grazing angle and ncRr perpendicular illunma- 
tion. as taught by the above-idcnt.lied pa'ent to Ertol et 

(s overcome 

The d:rection al wtiicn |,ght ,s prqcctec relative to 
a direction of travel of the sensor array along the surtacc 
of interest ,s one ma,cr factor m the development of a 
sufficiently high signal-io-noise ratio to provide reliable 
pos.iiorvcncoding or image-reproducfon information A 
second important factor is removing low spatial frequen- 
cy variations as might be caused by unavoidable non- 
un.formiiies ,n illummaiion across the lull sensor array 
field ol view Preferably the processing circuitry in- 
cludes DC removal circuits that transform the ongmal 
imaging ol the illuminaiion pattern into an image of local 
differences so that the low spatial Irequencies are re- 
moved but these are prelerential to the directions that 
can be locally differenced. i,e preferential to rows or to 
columns or to principal diagonals The third factor in- 
volves iho number of rows and the number of columns 
o sensor Clement, ,n the array. The gieater the numb.^i 
of elemcnis ,n one direction, the greater the renderable 
contrast in accumulation ol data with respect to that di- 
rection Thus, there is a ccrrelation between the number 
of Clements and the signal-to-no,sc ratio upon mov- 
ment in a particular direction. By accounting for each of 
the above three important factors, the strengths of one 
can be used lo offset the weaknesses of one or both o( 
the others in order to allow adequate correlation signals 
lor motions in any direction over the surface 

An embodiment of the present invention is de- 
scribed below, by way of example only, with reference 
to the accompanying drawings, in which. 

Fig. 1 is a perspective view of a preferred embodi- 
ment of hand-held scanning device following a mean- 
dering path on an original 

Fig 2 IS a surface plan view of imaging and naviga- 
tion sensors of the scanning device ol Fig 1 . 

Fig 3 IS a perspective view of the scanning device 
of Fig 1 . shown with the imaging and navigation sensors 
exposed. 

Fig. 4 is a schematic representation of a pnsm and 
grazing angle illumination from more than one lioht 
source 

Fig 5 IS a schematic representation ol grazing an- 
gle Illumination using a light source mounting adjacent 
to a navigation sensor, with an antireflection coating on 
a pnsm " 

Fig 6 IS a side view of an embodiment ihat utilizes 
a one-piece molded optical element to achieve the graz- 
ing angle illumination. 

Fig 7 IS a front view of the embodiment of Fig. 6. 
Fig. 8 is a schematic representation of an embodi- 
ment using a switchable combination of grazing angle 
Illumination and normal incidence illumination. 

Fig 9 IS a conceptual view of the image capture op- 
eration of ihe scanning device of Fig i 

Fig 10 is an operational view of one embodiment 
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of the navigation processing of the scanning device of 
Fig 1 

Fig 11 is a schcmalic view of selected steps of Fig 

9 

Fig 1 2 IS a schematic view of an embodiment v;ith 
cross-structured qrazinq angle illumination 

The preferred method may be utilized in any of a 
variety of applications including medicaf-related and 
computer-related applications For the purpose of un- 
derstanding the method will be described with refer- 
ence to computer scanners 

With reference to Fig 1 . a portable hand-held scan- 
ning device 10 is shown as having followed a meander- 
ing path 12 along an original 14 The crigma! may be a 
piece of paper, an overhead transparency film or any 
other image-bearing surface upon which illumination of 
the original at an angle of less than sixteen degrees will 
generate sufficient contrast to provide position informa- 
tion during navigation along the meandering path Typ- 
ically, the low intensity and high intensity features of the 
resulting illumination pattern are tracked and the posi- 
tion information is used lo rectify image data but other 
embodiments will be described The scanning device is 
preferably self-contained and battery powered, but may 
include a connection to an external source of power or 
to data ports of computers or networks 

The scanning device 10 of Fig 1 may include an 
image display 16. The display may provide almost im- 
mediate viewing of a captured image However, a dis- 
play ts not essentia! to the use of the scanning device 

The scanning device 10 allow^^ three degrees of 
freedom, with two being in translation and one in rota- 
tion. The first degree is the side-to-side movement (X 
axis movement) along the original 14. The second de- 
gree of freedom is movement upwardly and downwardly 
along the original (Y axis movement). The third degree 
of freedom is the ability to operate the device with rota- 
tional misalignment of a linear array of image sensor el- 
ements relative to an edge of the original 14 (B axis 
movement). That is. the linear array of imaging elements 
may have an angle of attack that is not perpendicular to 
the direction of device translation. 

Referring now to Figs 1-3. the forv/ard side 18 of 
the scanning device 10 may include a pivoting member 
20 that aids in maintaining proper contact between the 
original 14 and an imaging sensor 22. Navigation sen- 
sors 24 and 25 are located at the opposed ends of the 
imaging sensor. Because the navigation sensors are 
mounted on the pivoting member, the navigation sen- 
sors are in a fixed location relative to the imaging sensor. 

For reasons of physical compactness, the imaging 
sensor array 22 is preferably a contact image device, 
but for applications in which compactness is less of a 
concern or a smaller image is desired, sensors employ- 
ing projection optics may be employed, with magnifica- 
tion less than unity. In such applications, the elements 
of the imaging sensor 22 should be smaller and more 
closely packed together Contact imaging devices typi- 



cally employ lenses sold under the trademark SELFOC, 
which IS a federally registered mark of Nippon Sheet 
Glass Company Limited Less conventionally, contact 
imaging can be obtained using interleaved array ele- 
5 ments of sources and proximal sensors, v/ithout any im- 
aqing lenses Conventional imaging sensors for scan- 
ning applications may be used. The imaging sensor may 
be part of a unit that also includes an illumination source, 
illumination optics, and image transfer optics 

10 The imaging sensor 22 is shown as a linear array 
of discrete optically sensitive elements The spacing of 
the elements plays a role in determining the spatial res- 
olution of the scanner 10 For example, a linear array 
having a length of 1 01 6 mm requires 1200 sensor ele- 

'5 ments to achieve a resolution of 300 dpi. The sensor 
may be a charged coupled device (CCD), an amorphous 
silicon photodiode array, or any other type of linear array 
sensor known in the art. 

A key consideration in the design of the imaging 

^o sensor unit is speed The imaging sensor 22 preferably 
is able to image each pixel at approximately 10K sam- 
ples per second Linear imaging arrays generally pro- 
duce a serial data stream wherein pixel values, i e. 
charges, are placed into a shift register and then shifted 

25 out. Achieving the desired speed requires either very 
fast serial transfer rates out of the entire image array or 
multiple taps, so that pixel values can be shifted through 
fewer cells. This introduces parallelism, which is advan- 
tageous for digital processing 

30 Another consequence of the speed requirement is 

that the products of pixel areas, at the surlace of the 
original, and their solid angles of emitted light collected 
and conveyed to each array element should be suffi- 
ciently large to produce a detectable signal in integration 

^5 times on the order of 100 microseconds. An enhance- 
ment option is to add an optical element to the sensor 
to increase the effective fraction of sensor pitch for 
which each sensing element is responsive. Since there 
is typically unused area in the array matrix, such light 

•io collection optics increase sensitivity 

In Fig. 1 . the meandering path 1 2 is shown as hav- 
ing four and a fraction swaths, i.e. side-to-side passes 
across the original 14. A useful imaging sensor 22 for 
most opportunistic applications has a length within the 

•^-5 range of 25.4 mm and 101.6 mm. If the sensor 22 has 
a length of 63.5 mm. an A4 paper can be scanned in 
four or five swaths. The swaths should include regions 
of overlap, so that a stitching process can be used to 
produce a faithful reproduction of the original image. 

^0 The scanning device 10 typically includes at least 
one navigation sensor 24 or 26. In the preferred embod- 
iment, the device includes a pair of navigation sensors, 
with the sensors being at opposite ends of the imaging 
sensor 22. While a one-dimensional array of optoelec- 

55 tronic elements may be used, in the preferred embodi- 
ment, each navigation sensor is a two-dimensional ar- 
ray of elements. The navigation sensors 24 and 26 are 
used to track movement of the scanning device 10 rel- 
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alive to Ihe original ; 4 

The nflvigalion sonsors 24 and 26 ot F,g 2 etfec 
Mvoly observe a mov ng irTiagc o( :ho ons.nal 14 and pre. 
ducG an ,nd,ca;ion of Ihe d:sp:acc,-non! ,n iwo planar d. 
mensions between successive obscrvvilions As will b.^ 
oxplainod more lully below pixel values from the r^avi- 
qation sonsors are oporaled upon by procossinq ele- 
ments lo doto.mino proper mapping of ,mage data fror- 
Ihe imaging sensor 22 The processing elements oper- 
ate on a particular pi^eland its nearest neighbors topro- 
duco an array of correlation values ai each pixel loca- 
tion The correlation values are based upon compari- 
sons between a current image ol the surface structure 
and a stored image representing a known position o( in- 
herent structural features wherein the stored imag.^ 
serves as a position reference However operations' 
other than the correlation process may be employed in 
manipulating the input image data to form the output irr- 
ago 

Referring now to Fig 4, navicalion sensor 24 is 
shown as being opeiatively associated with illumination 
optics 11 the original 1 4 is a paper product for which sur- 
face irregularities are to be detected by the navigation 
sensor 24. the introduction ol light at a grazing angle 
causes the surface irregularities to cast shadows there- 
by creating an illumination pattern that is rich in contrast 
between bnghtly illuminated raised surface features and 
darker shadowed areas between the raised surtace fea 
lures Whne not essential one or more lighl emitting di- 
odes (LEDs) 28 and 30 may be used as illumination 
sources The grazing angle, which ,s the complemenl of 
the arigle o( incidence, is in the range of zero degrees 
and fifteen degrees, depending upon the propemes of 
the original 14 The optics may comprise a single ele- 
ment or a combination ol lenses, filters and/or holo- 
graphic or diffractive elements to accomplish suitable 
collimated and generally uniform illumination of the tar- 
get surface. The wavelength of the light emitted by the 
source 28 and 30 should be selected to enhance the 
spatial frequency information available for navigation 
Fixed pattern noise in the illumination field should be 
minimized The output of source 28 may require adjust- 
ment to accommodate wide dynamic ranges of reflec- 
tivity of the original as the scanning device proceeds 
over printed materials with absorbing or reflecting inks 
or other marking agents 

The magnification or demagnification of navigation 
imaging optics should be constant over the field-ol-view 
of the two-dimensional sensor array 24 which detects 
he imaged light from the surface In many applications, 
the modulation transfer (unctions, i.e the amplitude 
measure of optical frequency response, of the naviga- 
-on optics must be such as to provide attenuation before 
he Nyquist frequency that is determined by the pitch ol 
the sensor elements of the navigation sensor and by the 
magnification of Ihe optical elements The optical ele- 
ments Should also be designed to prevent background 
•llumination and stray light from creatine noise Note that 



a wavefron: 3p;;;;:ng beam-spi.ltor coUd olso bo usoo 

lllum,r,a;i,.,3 ^ large; rog o,. ol a,n original 1 4 at an 
ang.e cf less th£.n sixteen degrees works well for appii- 
ca„ons ,n which the surface o! the original has a high 
- cegrce of uncve.-.ness For cx.,-.pio. tie introduction ol 
^c?. .t l.'cm the scree 23 at a grazing angle provides a 
hign s,gnal-to-no.se raiio ol dai.-, related to surface fea- 
tures v.hcn I,' o original is slal.onery, cardboarc fabnc 
or human sk.n Grazing angles of illumination cenoraie 
longer shadows .nd more apparent contrast than will 
Illumination p-0;e.ted at an angle ol sixteen degrees or 
greater relat.vc to the su^ace of the orig.nai. That is il 
the surlace 01 the original ,s not flat smooth and glossy 
(he AC signal level ,s greatly enhanced by use of grazing 
angles of illur-.inaticn On the other hand, the DC signal 
level increases as ihe illumination angle approaches the 
normal to the original 

Fig 4 ilijstrdtos an embcdimont ol achieving a 
grazing angle ol iliumination by means ol a prism 31 
' The prism may be made ol common optical crown glass 
suet, as the type sold by Schottunde, Ine model numbe, 
BK-7 glass lor vvh,chn = l 5155 Two illumination sourc- 
es 2a and 30 project light that is collected by lenses 02 
and 33. respectively, and collimated before entering the 
- prism o 1 The light ,s redirected upon exiting the prism 
to strike a surface of the onginal at a grazing angle ol 
ess than sixteen degrees to the surface of the original 
Light scattered from a target zone of the surface is col- 
lected by an upper lens surlace 34 ol the pnsm and ,s 
^0 directed at the navigation sensor 24 The navigation 
sensor may be clocked electroncally to provide succes- 
sive Irames ol the illumination pattern at the surface 
The successive frames may be correlated in a manner 
to be described below, but correlation is not cntical 

In an acceptable embodiment, the prism 31 has fac- 
es 35 and 36 whoso normals are sloped by approxi- 
mately 40 7 degrees from the normal of the surtace ol 
he ordinal 14 Such a slope permits the light emitted 
(fonn the illumination sources 28 and 30 to be normally 
incident onto the prtsm faces, so thai the central rays 
are unlikehy to undergo any significant refraction upon 
entenng the pnsm. Thus central rays of light can be 
made to strike the dislal lace 37 of the prism 31 at an 
angle of 40 7 decrees, slightly less than the angle o! total 
'5 internal reflection lor BK.7 glass. The light transmitted 
Ifom the distal face 37 will be at a grazing angle to the 
surface of the original. For BK-7 glass and an angle of 
40 7 degrees the incidence angle of light striking a lar- 
get zone ol the original will be approximately 82 degrees 
with respect to the normal ol the surface, i e. a grazing 
angle cf eight degrees with respect to the plane of the 
surface In practice, the illumination beams should be 
positioned 10 be centered around a target zone of the 
surface. The target zone remains stationary relative to 
Ihe pnsm 31 . but moves relative to the surlace as the 
scanner is relocated. 

In the embodiment of Fig 4. the lens surtace 34 ol 
the pnsm 31 is shaped w.ih rotational symmetry about 
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an optical axis defined by the center of the navigation 
array 24 and the center of ihe target 7one of the surface 
of the original 14. While not shown, the lens surface 34. 
which exhibits optical power nnay be replaced with a pla- 
nar segment, and a lens or lens system separate from 
the prism geometry could be used to image the target 
zone onto the navigation sensor 24 In yet another al- 
ternative embodiment, the optical power of the collima- 
tion lenses 32 and 33 could be achieved by properly 
shaping the prism faces 35 and 36 

Where the navigation determination is to be ac- 
quired via image correlation, accuracy and precision of 
the determination nnay be enhanced by improving the 
uniformity of illumination over the imaged target zone of 
the surface of the original 14 Illumination uniformity may 
be improved by employing techniques of energy rema- 
pping, such as by suitably reshaping two or more ol the 
optical surfaces in the illumination path of each of the 
sources 28 and 30. As an example, the surfaces of the 
coltimalion lenses 32 and 33 and/or the prism faces 35 
and 36 may be leshaped. If there is a refracting surface 
in the construction of the illumination sources them- 
selves, these surfaces may also be employed in the en- 
ergy remapping. Such remapping to accomplish uniform 
power across beam cross sections is knov/n art, but the 
flexibility m incorporating part of the energy remapping 
optics into the prism design is considered novel 

Optionally the preferred embodiment may incorpo- 
rate a diffusing function onto the lens surface 34 of the 
prism 31 A separate or alternative diffusing element 
may also be used between the prism and the navigation 
sensor 24 The purpose ol the diffusion is to transform 
the signal power into spatial frequencies either near to 
or lower than the Nyquist limiting spatial frequency 
(which is related to the pitch of the sensor elements of 
the array 24). That is. a diffuser would provide a roll-off 
of spatial frequencies which could otherwise cause 
aliasing in the correlation operation and at the same time 
boost the signal energy of lower spatial frequencies. 

The use of a grazing angle of illumination to achieve 
a high contrast illumination pattern along the target zone 
of the original 14 is not limited to acquiring navigation 
data. Projection at a grazing angle v/:l! cause raised print 
on a page to cast shadows, so that this embodiment may 
be used to form an image of pnnt on a page. 

There are a number of advantages to employing a 
prism 31 to provide grazing angle illumination from a 
source 28 and 30 of light. Firstly, as shown in Fig. 4. 
multiple sources of illumination may be used simultane- 
ously without as much loss in contrast Also, the prism 
lowers the loss factor due to geometrical projection of 
the illumination beam and the consequent surface 
brightness at high points of the surface that arc in inti- 
mate contact with the prism face. Without the prism the 
loss factor is cos (QO'-S*) = 0 1 39 at eight degrees graz- 
ing incidence. However, with use of the prism having an 
index of refraction of 1 5185 the equivalent loss factors 
become cos (90°-40 7°) = 0 652 Consequently, the im- 



provement in this factor with use ol a prtsm at eight de- 
grees over no prism is 0 652/0 13<^ = 4 6Q 

Another advantage of the use of the prism is that 
divergence ol the incident beam within the prism is re- 

5 duced. Moreover, there no longer is a strong need for 
collimation in any plane perpendicular to the plane of 
incidence, where the plane of incidence lies parallel to 
the surface normal Thus, a number of illumination 
sources may be arranged around the normal viewing ax- 
IS. yielding improvements in the illumination irradiance 
by the same multiple as the number of sources or con- 
sequent increase in total source area 

Yet another advantage to using a prism 31 in the 
optical detection path is that it provides an opportunity 
to use the faces of the prism to mount navigation optics 
without significantly widening the overall package. A 
prism may also provide a significant reduction in the tol- 
erance required to translationally position the illumina- 
tion at the target zone of the original 1 4, since the beam 

20 cross section which projects onto the target is larger with 
the prism than without it. The reduction in the tolerance 
using a prism is inverse to the ratio of the cosine of the 
incidence angle before leaving the prism to that after 
leaving the prism. Controlling the beam angle to aim the 

25 incoming beam of illumination to strike a region of inter- 
est of an original 14 at the desired grazing angle how- 
ever becomes more demanding with the use of a prism. 
Another disadvantage of using a prism in the above 
manner, wherein the illumination is injected into the 

30 prism along the normal to the input face, is that the input 
beam must be colltmated better within the plane of inci- 
dence as well as aimed more precisely in angle. These 
two effects can be reduced by embedding the source 
v/ithin the prism medium or reduced or eliminated by in- 

35 creasing the slope of the first prism surface and increas- 
ing the angle of incidence as shown in Fig. 5. 

Referring now to Fig. 5. a prism 38 is shown as hav- 
ing sloped prism faces 39 and 40 to allow incident illu- 
mination from a source 41 to be initially parallel to the 

•^0 normal of the surface of the original 14. The angles of 
the prism faces 39 and 40 are approximately 81 .43 de- 
grees, again assuming that the index of refraction of the 
prism material is 1 ,51 85. This angle is also the angle of 
incidence of light that strikes the surface after being 

'f5 emitted from a prism. 

The embodiment of Fig. 5 permits the incidence an- 
gle at the dista! face of the prism 38 to be the same 40.7 
degrees as described with reference to Fig. 4. Conse- 
quently, the prism may have a lens surface 42 identical 

50 to that of the one described with reference to Fig. 4. That 
is, the lens surface 42 collects light from a target zone 
of the original 1 4 and images the target zone onto a nav- 
igation sensor 24. Both the navigation sensor and the 
illumination source 41 are shown as being mounted to 

55 a contact surface 43 of a scanning device. 

The distal prism face. i.e. the surface of the prism 
38 that is closest and parallel to the surface of the orig- 
inal 14. should be kept in close proximity to the original 
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in order ,ha. .he largo, .one ,s kcp, ,n locus a, Iho array 
2^ and ,n order lhal Ihe l,gh, emerging from ihc pr,sn 
lully ,llum,nales iho tarcol zor.e The w dih or the ,llum. 
nal.on beam l,om ihe source 41 ,g designed to bo sul- 
(iccnlly broad that the target zone remains fully illumi- 
nalcd even ,( ihere is some sepa-ation bc-ween the 
prism and the original 

A concern that arises witn Ihe use of the pnsm 36 
relates lo refleclion losses Reflcciion losses can bo sic- 
nucanl. especially for polarization perpendicular to the 
plane ol mcdonce The pnsm 35 of Fig 5 ir.cludes an 
aniireflective coating 45 ,n order lo improve Iransmil- 
lance and reauco reflection losses While not shown 
preferably Ihe various faces of the pnsm include Ihe 
aniirefleclive coating Some of ihe potential reflection 
losses are dluslraied by dashed l.nes ,n Fig 5 In com- 
parison the reflection irom the distal face 37 ,n Fiq 4 
will be partially redirected by reflection from the pr^m 
faces 35 and 36 to combine w,th the cngmai beams in 
being directed at the distal face 37, and ihus will not be- 
come a souice ol pallom noise 

The aniireflective coaling 45 may oe formed usmq 
known thin-f.lm multilayer dielectric coating techniques 
For example, a two layer V-coat with the appropriate 
choice of index materials and thickness may be applied 
Without an aniireflective coating at the distal face the 
reflections of the parallel and perpendicular compo- 
nents ol polarization at the incidence angle of 40 7 de- 
grees lor an index of refraclion of! 5 1 55 will be approx- 
'malBly 36% and 65%. respectively The two layer V- 
coat having the appropriate choice of index materials 
and tnickness reduces either one of these reflections to 
below 1% and reduces the other reflection to below a 
lew percentage points. 

The Illumination source 41 may be a source of in- 
coherent light, but this is not critical Incandescent 
lamps, ligh, emitting diodes, laser diodes and laser di- 
ode arrays may be utilized. For a hand-held scanner 
the use of a light emitting diode .s preferred, since it pro- 
vides reliability and compactness Coherent sources are 
acceptable, but may cause problems by producing 
speckle It .s possible lo cast a light emitting die directly 
into the prism 38. in which case the illumination source 
could be positioned very near the target zone with re- 
lective cups and/or diffraction "lenses" being configured 
to obtain the desired collimation. 

The pnsm 35 may be formed of any of a variety of 
materials. Molded glass, ground glass, polished glass 
and molded or cast plastic are suitable materials 

In comparing Figs 4 and 5, a single illumination 
source 41 may be used to provide the grazing illumina- 
I'on of the original, or a number ol sources 28 and 30 
may be used In some applications, the multidirectional 
floodlighting- in Fig 4 effectively increases Ihe appar- 
ent surface bnghtness without a corresponding loss in 
contrast. For example, if the texture of the original 14 
defines a raised net-like pattern, the low-lying areas ol 
Ihe Illuminated region may be sufficiently low so as not 



o intercept rays regardless ol the direction from which 
>he grazing ,nur.,n.:ion IS ..r,g,na,ed In such a case the 
muUi-sourcecmbcdimentolFig 4 is preferred By pro- 
v.ding more than one so.rce o: illum.nation, ,he high- 
lying areas ol the il!umin...;ed region scatter a greater 
-nlensity of light but the lo.v-lyinc, areas remain with^ 
Shadows .^unncr.Tore if :,'io illuminal.on remains at an 
angle of incider-,ce of less man sixteen degrees the Ho-,, 
^ need not be coilimaicd in order to obtain sufficient coo- 
irasl in an imago ol the target region 

Referring now to Figs 5 and 7, a one-piece molded 
opt.c 53 IS provided in order to deflect normally incident 
^umination from a source 55 into sub-sixteen degree 
^^umination at a large: that ,s represented by hne 57 
The optic deflects the illumination at a surlace 59 that 
(unctions as a lolal-iniernal-rellection (TIR) mirror The 
surface 59 is near 49 degrees relative lo the illumination 
(.om the source 55 The source may be an LED with a 
single lens and one or several square die. or may be an 
LED having a single rectangular die The LED lens may 
be refiacting oi dilticcting 

Ri mk" x^o "'^ at a region 

61 of the TIR mirror 59 The reflected ligh, energy pass- 
es through an opt,c-to-air interlace surface 63 prior ,o 
-s reaching the target region 57 of the surface of interest 
Consequently, the contact surface 65 of the optic 53 is 
separated from tne target region that ,s illuminated Re- 
flection from Ihe target region enters the optic 53 at a 
recessed surface 67 The reflected lignt energy passes 
-^c througn the optic to s.nke an off-axis elliptical mirror or 
reflecting diffractive lens 69. From the mirror or diffractor 
69^ the Itght energy is directed to a flat mirror 71 that 
redirects the light energy ,o a two-dimensional array of 
sensor elements 73. Consequently, the reflected light 
follows a folded path from the target region 57 to the 
sensor array 73 

The recessed surface 67 that is out of contact wiih 
the surface of interest ,s associated with a number of 
advantages. The optic 53 may be considered to have a 
recessed, out-of-focus. dust-prolect.ng, media window 
The window acts to keep dust. dirt. and other foreign 
rriatter from entering the interior of the unit. Ivioreover 
the window IS removed from the image plane (i.e the 
plane of the surface of interest) to reduce the suscepli- 
bility Of the surface 67 to scratches and dust that would 
be imaged by the sensor array 73. The recessed window 
also enables the sub-sixieen degree illumination to be 
inlrcduced below the level of the surlace 67. thereby 
avoiding any complications associated with mtroducinq 
grazing light through a glass-to-air interface immediate 
ly adjacent to the surface of interest. Instead, the illumi- 
nation IS passed through a side.vall window surface 63 
that forms an edge ol the recessed window 

Referring now to F,g 8. normal incidence illumina- 
tion IS shown as being provided as a selectable alterna- 
live to the grazing angle illumination of Fig. 5 An iflumi- 
nation source 49 directs light to a reflective element 47 
that IS centered on the optical axis from a navigation 
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sensor 24 to a target zone of the original 14 The light 
reflected by the optical element 47 provides illumination 
of the target zone at generally norma! tncidepce to the 
surface Note that the marginal rays of the fllumtnation 
beam at the 45-degree optical element 47 do not sub- 
tend as large an angle from the target zone as does the 
lens surface 42 itself This is to permit only those scat- 
tered rays that lie more than five degrees outside the 
marginal incident rays to pass beyond the 45-degree op- 
tical element and be received at the navigatbn sensor 
24 

The use of incoherent light at a normal angle of in- 
cidence may be preferred in appiicahons in which posi- 
tion or image data are to be acquired from originals such 
as photographs, glossy magazine pages, and overhead 
transparency tilms. While the original may not have suf- 
ficient surface roughness to reliably determine naviga- 
tion along the original by means of tracking shadows 
and highly reflective raised surface features, the original 
may exhibit rich texture when viewed five degrees or 
slightly moie away from the direction of reflection, since 
light scattering from inhomogeneilies in refractive index 
in the original 14 or from defects in surface coatings or 
films will provide the required basis for determining nav- 
igation. 

Coherent illumination may also be introduced at 
normal incidence in order to permit speckle-based nav- 
igation. Relative motion between a scanning device and 
an original may be tracked by monitoring motion of 
speckle relative to one or more navigation sensors 24 
If coherent illumination is used without using imaging 
optics, then by selecting a small area of illumination and 
by having a relatively large separation between the sur- 
face of the original and the navigation sensor the result- 
ing predominant speckle cell sizes vyiih coherent illumi- 
nation can be sufficiently large to satisfy Nyquist sam- 
pling criterion. 

The use of a larger aperture beam splitter or even 
a similarly large annular reflector instead of the smaller 
reflector 47 allows both the incident illumination and the 
detected scatter to be normal and/or near normal to the 
surface of the original. These latter field arrangements 
provide excellent features of high brightness and con- 
trast from photographic media in particular but require 
the image to be magnified in order that the features be 
larger than typical sensor array elements. It does not 
work well on diffuse media 

Grazing angle illumination is accomplished using a 
prisfTi 38 and a source 41 of illumination similar or iden- 
tical to the prism and source of Fig. 5. Light from the 
source 41 is redirected at a first prism face and Is then 
projected onto the original 14 at a grazing angle upon 
emission from the distal face which is at the surface. An 
image of the target zone of the original is formed at the 
navigation sensor 24. 

While this embodiment has been described and il- 
lustrated as having a prism that includes sudaces hav- 
ing specified slopes, other configurations of prisms may 



bo utilized to accomplish the desired grazing angle of 
illumination In fact, a prism is not ?^ critical element, 
since the grazing angle can be accomplished using oth- 
er known optical elements, such as mirrors Additional 

•5 optica! elements may also be employed for various pur- 
poses, such as trapping or baffling of stray light or to { 1 ) 
improve the power distributions in beam cross sections. 
(2) define beam aperlures (3) block specularly reflected 
light and stray light, and/or (4) improve collimation in the 

^0 planes where this is necessary to maintain a high con- 
trast in the navigation images of the surface. 

Referring now to Fig 9: the scanner 1 0 is shov/n as 
being moved across an original 44 having a block 46 
imprinted onto a surface of the original. Because the 

?5 scanner 1 0 is not subjected to any kinematic constraints 
in the plane of the original, there is a tendency for a user 
to follow a curvilinear path across the original, as when 
the hand and forearm of the user rotate about the elbow 
In Fig 9. the scanning device is shown as following a 

20 curved path 48 across the block 45. If the lower edge of 
the scanning device is the edge that is closei to the el- 
bow that defines the axis of rotation, the lower edge will 
have a shorter radius. Consequently, imaging elements 
of an imaging sensor will vary with respect to the time 

2S and distance required to pass over the block 46. A dis- 
torted image 50 of the block is captured as the device 
is moved to the second position 52, shown in dashed 
lines. 

The captured image 50 would be the stored image 
30 in the absence of processing to be described below 
However, as the imaging sensor captures data related 
to the block 46. navigation information is acquired. In 
the preferred embodiment, one or more navigation sen- 
sors capture data related to surface irregularities of the 
3S original 44. Movement of the surface irregularities rela- 
tive to the scanning device 10 is tracked in order to de- 
termine displacement of the imaging sensor relative to 
the block 46. A faithful captured image 54 may then be 
formed The image 54 is defined herein as the "rectified" 
-^0 image. 

In Fig. 10, one embodiment of navigation process- 
ing is shown. The navigation processing Is performed 
by correlating successive frames of navigation Informa- 
tion, such as data representative of the illumination pal- 

-^5 lern formed by highly reflective raised surface features 
and the shadowed areas between raised surface fea- 
tures. The correlations compare the positions of the fea- 
tures in successive frames to provide information relat- 
ed to the position of a navigation sensor at a particular 

so time. The navigation Information is then used to rectify 
image data. The processing of Fig. 10 Is typically per- 
formed for each navigation sensor. 

In a first slop 55. a reference frame is acquired. In 
effect, the reference frame is a start position. The posi- 

55 lion of a navigation sensor at a later time may be deter- 
mined by acquiring 58 a sample frame of position data 
from the navigation sensor at the later time and then 
computing correlations 60 between the reference frame 
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and the laler-acq jircd sample Iramo 

Acquiring ihe in.iial reforence Irame 56 may lakc 
place upon .n,:,at:on of ihe imaging process For exam- 
ple Ihc acqu,s;l,oo may be IriggcrccJ by mefe placement 
ol the scanning device inio contact with the original Ai- 5 
lernatively Ihe scanning device nay include a start bal- 
lon that initiates Ihe image process and the navigation 
process Initiation may also take place by a periodic 
pulsing of the illumination system ol each navigator II 
there ,s a reflected signal that exceeds a prescribed >o 
threshold of reflection or a correlai:on signal that indi- 
cates motion, the reference frame is then acquired 

While the navigation processing is performed com- 
pulaiionally the concepts of this embodiment may be 
described with reference 10 Figs 10 and n A reference '5 
frame 62 ol Iho illumination pattern ,s shown as having 
an .mage of a T-shaped feature 64 The size of the ref- 
erence Irame depends upon factors such as the maxi- 
mum scanning speed of the scanning device the dom- 
inant spatial frequencies in the imaging of the structural 20 
features, and the image resolution of the sensor A prac- 
tical size of the reference frame for a navigation sensor 
that IS thirty-two pixels (N) by s.xty-four pixels (M) is 
24X56 pixels. ^ ' 

At a later time (dl) a navigation sensor acquires a 25 
sample frame 66 of the illumination pattern which is dis- 
placed with respect to frame 62, but which shows sub- 
slanliatly the same features, including the T-shaped fea- 
ture 64 The duration dt is preferably set such that the 
refalive displacement of the T-shaped feature 64 is less 30 
than one pixel of the navigation sensor at the velocity of 
translation of Ihe scanning device An acceptable time 
period is 50 ps for velocities of 0.45 meters/sec at 600 
dpj 

If the scanning device has moved during the time 3S 
period between acquiring 56 the reference frame 62 and 
acquiring SB Ihe sample frame 66, the first and second 
images ol the T-shaped feature will be ones in which the 
feature has shifted While the preferred embodiment is 
one in which dt is less than the time that allows a full- ^0 
pixel movement, the schematic representation of Fig 1 1 
shows the feature 64 as having shifted upwardly and to 
the right by one pixel The full-pixef shift is assumed only 
to simplify the representation. 

Element 70 in Fig. 1 1 represents a sequential shift- 45 
-ng ol the pixel values of frame 66 into the eight nearest- 
neighbor pixels That IS, step "O" does not include a shift 
slep 1 ■ IS a diagonaf shift upward and to the left step 
2 IS an upward shift, etc. In this manner, the pixel-shift- 
ed frames can be combined with the sample frame 66 so 
to produce the array 72 of position frames The position 
frame designated as "Position 0" does not Include a 
shift, so that the rcsufl is merely a combination of frames 
62 and 66. -Position 7" has the minimum number of 
shaded pixels, and therefore is the frame with the high- 55 
est correlation Based upon the correlation results the 
posilion of Ihe T-shaped feature 64 in the sample frame 
66 IS determined to be a diagonal rightward and upward 



shift relative 10 t,',e position of the same feature in earlier- 
^cquired reference frame 62, wh.ch implies that the 
scanning device has moved leftwardly and cownwardly 
during lime ai 

While other ccrrelalion approaches may be cm- 
ployed, an acceptable approach 13 a "sum ol the 
squared diflcrcnces- correlation For the embodiment of 
i-ig 11, there are nine correlation coefficients (C^ = C 
C, Cg) formed from the nine oflscis at element 70 
with the cor,ola:,on coefficients being determined by 



Where S„ denotes the navigation sensor-measured val- 
ue at the position ij of the sample Irame 56 and R de- 
notes the navigation sensor-measured value J! the 



frame 62 as shifted at the element 70 in the k direction 
with k being the identifier of the shift at element 70 In 
f-ig n, k-O provides the correlation coeflicieni with the 
lowest value. 

Correlations arc used to lind the locations of iden- 
tical leatures in successive frames in order to determine 
the displacements of the features from frame-to-frame 
Summing or integrating these displacements and cor- 
recting for scale factors introduced through the design 
of the relevant optics determine Ihe displacements of 
the imaging sensor as a scanning procedure progress- 
After the correlation step 60 of Fig 10 has been ex- 
ecuted for a sample frame acquired ai step 58 a deter- 
mination IS made as to whether to maintain or replace 
the reference frame. This is shown as slep 74 If the 
same reference Irame is to be used lor subsequent cor- 
relation computation, the process returns to step 58 and 
a new sample Irame is acquired On the other hand for 
applications in which there is to be a substitution of ref- 
erence frames, step 76 shows the use of the previously 
acquired sample Irame as a new reference frame prior 
to returning to slep 53 to acquire a new sample frame 
While the process provides a high degree of corre- 
lation match, any errors that do occur will accumulate 
with each successive shift 76 of a sample Irame 65 to 
the relerence frame designation. In order to place a re- 
striction on the growth rate of this 'random walk" error 
a sample Irame is stored in a separate buffer memory 
This separately stored sample frame becomes a new 
reference frame for a subsequent series of correlation 
computations As an example, the new reference Irame 
may be introduced after a fixed number of correlation 
computations. 

The sampling period dt docs not have to be con- 
stant. The sampling period may be determined as a 
function of previous measurements One method that 
employs a variable dt is to Improve the accuracy of dis- 
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placemenl calculattcn by keeping the relative displace- 
monl between successive reference fr^^mes wtihm cer- 
iHin bounds. For example, the upper bound nnay be one- 
pixcl displacement while the lower bound is determined 
by numerical roundcft considerations in the processing 
ol the navigation data 

Referring again to Fig 11. the T-shaped feature 64 
mny be a shadov/ that is cast by directing light from an 
Illumination source at an angle of less than sixteen de- 
qfcos relative to the surface of the original On the other 
hand the feature may be representative of a raised area 
on the surface so that the area is highly reflective. That 
IS the feature may be a tow intensity feature or a high 
intensity feature 

In one embodiment the pixels of the reference 
Iramc 62 represent a field ol view of 40 |.im The actual 
cross section o! each sensor element of the navigation 
array ts 60 pm The optical elements of this embodiment 
provide a magnification of 150% It should be noted in 
Fig 9 that the delected leature 64 has a cross section 
of fit icdst two fields of view A 2 i ratio of leatuie-to- 
field of view IS dictated by Nyquisl criteria For use of 
the method and device in reproducing an in^age ol the 
surface of the original, the high tntensily and lovy inten- 
sity tcalurcG may bo a result of surface roughness 
fornncd by a screen in the manufacturing process of the 
paper Typical cross secttonal dinnonsions of paper fib- 
ers are m the range of 25 urn to 40 um Thus, tracking 
paper fibers is typically not desirable 

Projecting light at less than sixteen degrees relative 
to the surface of the original causes surface features 
thai are typically not delectable to the human eye to cast 
shadows that provide an illumination pattern having suf- 
ficient depth of intensity modulation to allow tracking of 
features that satisfy the above-identified cross section 
requirement Additionally printed matter may be im- 
aged, since the raised print will cast shadows when illu- 
minated by light that is projected at an angle of less than 
sixteen degrees relative to the paper on which the print 
is located 

The direction in which light is projected relative to 
the direction of travel of the sensor array that is used to 
capture image-reproduction or position-encoding infor- 
mation IS one major factor of the signal-lo-noise ratio for 
the processing of the information. Another important 
factor IS the number of sensor elements The greater the 
number of sensor elements in the direction perpendic- 
uldr to travel, the greater the number of high intensity 
and low intensity featutes tliat will be captured in each 
frame. Since the capture of features provides informa- 
tion of the tracking of the path of the sensor array, a 
greater number ol sensor elements will increase the sig- 
nal portion of the ratio Thus, the "v/cakncss" of the di- 
rection of illumination with respect to array travel per- 
pendicular to the illumination direction can be offset by 
an increase in the number of sensor clcnnents in that 
perpendicular direction A third factor in the determina- 
tion of the signal-lo-notse ratiots DC removal DC remov- 



al suppresses illumination characteristics that are com- 
mon within a neighborhood of sensor elements DC re- 
moval circuits transform an original frame 62 into an im- 
age of local differences The local differences approach 
5 results in an image in which low spatial frequencies arc 
removed, thereby faciliLilinq ccrrelalions. DC removal 
is most easily carried out in a rov^-by-row fashion with 
local differences taken only along the rows during the 
transfer of pixel values in the frame along the rows of 
^0 pixel values If the removal of DC components is to be 
carried out in a row-by-row fashion, a column-by-column 
fashion, or both the selection of the fashion may be 
made in accordance with offsetting the weaknesses of 
one or both of the other imiportanl factors in determining 
the signal-to-noise ratio 

Thus, there arc a number ol ways ol offsetting the 
correlation function asymmetry introduced as a function 
of the direction of relative movement between a sensor 
array and a surface of interest. Fig 1 2 illustrates an em- 
^0 bodimenl (or reducing the effects of this faclor m the tn- 
tioduction of asymmetry The embodiment of Fig 12 il- 
lustrates cross-structured grazing illumination In the 
preferred embodiment, a first source 100 of illumination 
is oriented generally along the direction of rows of sen- 
25 sor elements in the sensor array A second illumination 
source 102 is oriented generally along the direction of 
the columns in the sensor array The target region of a 
medium is divided into two regions 104 and 106, since 
each of the sources is positioned to illuminate only a 
^0 portion of the total area to be imaged Optionally, there 
is an overlap of the two regions If each illuminated re- 
gion 104 and 106 is approximately equal in size, e.g., 
32x32 pixels, the entire sensor array may be 32x64 
sensor elements However, there is typically some over- 
^5 lapping as the illumination from one of the two sources 
"spills over" into the other region. The overlap does not 
seriously reduce the image contrast 

The sources 1 00 and 1 02 may be LEDs that gener- 
ate beams 108 and 110 with narrow angles of diver- 
-io gence measured in their planes of incidence parallel to 
the surface normal Each beam has an angle of inci- 
dence 1 1 2 and 1 1 4 that is less than sixteen degrees rel- 
ative to the associated region 104 and 106 of the medi- 
um. Each region is simplislically shown as having three 
•^5 shadows that extend in directions generally perpendic- 
ular to the associated beam 108 and 110. The cross- 
structured illumination of Fig. 12 significantly reduces 
the correlation function asymmetry. 

The disclosures in United Slates patent application 
50 no. 08/627.625. from which this application claims pri- 
ority, and in the abstract accompanying this application 
are incorporated herein by reference 

55 Claims 

1 . A method of acquiring data related to topography of 
a medium comprising the steps of 



11 



EP 0 800 307 A2 



3. 



pfOv,d:ng a str^ctoro (10) includ.ng an ,llam,na. 
ion source (26 30 41 4 q 55 100 102) and 
an array of sensor elerr.eois (24 26 73) m 
which each sensor cicmcnl has a field ot viev 
diroccng radiation (rom saia illummaiion source 
a: a surface of said medium such thai said ra- 
dialion dofir.es a path thai is substantially fixed 
relative to said sensor including establishing 
said path to be at an angle (112.114, less than 
sixteen degrees relative to said surtace there- 
by forming an iflummalion pattern on at least a 
portion of said surface such that said iliumina- 
lion pattern includes first areas (64) of relatively 
high brightness corresponding to raised sur- 
face features ol said medium and second areas 
ol relatively low bnghiness 
providing relative movemeni between said 
structure and said medium: 
during said step ol providinn relative movement 
and by moans ol said senscr. delecting (55 58) 
said lust a.eas of lelatively high biightness and 
said second areas of relatively low brightness 
and 

(omiing an image (54) of said surface of said 
medium including tracking positions (72) of 
said first and second areas during said step of 
providing relative movemeni in order to deter- 
mine at least one of position encoding informa- 
tion and image information 
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A method as in cfaim 1 . wherein said step ol direct- 
ing radiation includes coliimating radiation from an 
incoherent illumination source (28 30 41 aq 
100.102). ■ ' 

A method as in claims 1 and 2, wherein said step 
of providing said structure (10) includes providing a 
two-dimensional array of sensor elements said 
step of detecting said first and second areas includ- 
.ng positioning saidarray at or generally parallel and 
near to a conjugate image plane of said surlace of 
said medium (14. 44). 



A method as in claim 1 . 2 or 3. wherein said step of 
detecting said first and second areas includes the 
step of forming successive images (55. 58 62 66) 
Of primarily only those first and second areas havina 
^ dimension at least twice as large as a dimension 
of said field of view of each sensor efement said 
step of forming an image (54) including tracking so 
said first and second images in said successive im 
ages to determine position encoding information 
(60) 



30 



nei.od as in any preceding claim wherem sa,d 
s.ep o. direcng radialion includes .tlachmg a prism 
U-1 3o)to saidstruciureilO) to be within a first path 
'f-m said i.i^minaiion source to said medium (14 
-nc 44) and witnin a second path from said medium 
10 said iifra; (24) of schsor elements 

A netnod as m claim 6 comprising the step of di- 
rect^g a Plurality of beams of light (4 , . 49) into said 
pn.m (3to) such that said pr.sm redirects each beam 
approach said surtace at an angle of less than 
s.x.een deg.'ces from said surface 

A covice lor acquiring dala related to topography ol 
a mecium comprising >- a k y w 

a hand-manipulaiabie housing (lO) includinq a 
generally planar lace for positioning in substan- 
iialfy parallel relationship with a surface of said 

medium. 

anilljmina:ionsoufce(2S. 30. 41 49 55 lOO 
102) connected to sa.d housing at sa.d planar 
lace 

an array (24, 26, 73) of sensing efemenls posi- 
tioned along said planar face and 
an optical arrangement (31; 38; 53) connected 
to said housing for directing light from said illu- 
mination source to reach said surface at an an- 
gle ( 11 2. 1 1 4) of less than sixteen degrees ref- 
ative to said surface and for redirecting scat- 
tered light from sa.d surface to impinge said 
sensing elements. 

A device as ,n claim 8, wherein said optical arranqe- 

'a.e (35, 3d: 39, 40) distal to said housing (10) and 
substantially parallel to said planar face. 

10. A device as in claim 9. wherein said illumination 
source (28, 30; 41; 49) includes a plurality of light 
sources directed to project light energy into said 
prism (31; 38), said prism being configured to re- 
lease said light energy from each of said light sourc- 
es at an angle of less than sixteen degrees relative 
to said surface of said medium (14. 44). 



9. 



A method as in claim 4, wherein said step of lorming ss 
an image (54) includes detecting print information 
on said surlace ,n a manner independent from use 
01 said sensor elements 
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